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(54) Copyright Information emi3edding apparatus 

(57) A copyright information embedding system is 
provided which is designed to embed information for 
copyright protection into digital audio signals without 
deterioration of analog audio signals reproduced. The 
copyright information embedding system includes an 
A/D converter (31). a modulator (116). a level detector 
(200), and a copyright data embedding circuit (40). The 
A/D converter (31) converts an analog audio signal into 
a digital signal. The modulator (116) modulates a copy* 
right data signal for the digital signal using spectrum 
spread. The level detector (200) detects a variation in 
level of the digital signal. The copyright data embedding 
circuit (40) divkles the copyright data signal into several 
codes and embeds them into the digital signal each time 
the variation in level of the digital signal shows a prese- 
lected variation such as a rapid rise or drop. 
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Description 

BACKGROUND OF THE INVENTION 

5 1 Technical Field of the Invention 

The present invention relates generally to a copyright information embedding apparatus designed to embedding 
information for managing copyright in a storage medium when recording analog signals such as audio signals In digital 
form, and a record carrier recording thereon that Information. 

10 

2 Background of Related Art 

Optically readable discs such as "Compact Discs" have come into wider use as audio record can^iers than conven- 
tional magnetic tapes. An EFM recording fbrnfrat using 8-bit fixed length data symbols and a data format including a sub- 
75 code, audio data, and a CRC are established as logical formats for CDs. CD players having a variety of application 
functions are being developed. 

CDs are also used as CD-ROMs by discriminating control bits (four bits) in a subcode of a Q channel or detecting 
the absence of a TDC and have wide applicability to the field of electronic publication for mass storage and high-speed 
access. The CD-ROMs, however, have the drawback in that audio signals are compressed by ADPCM. which makes it 
20 Impossible to reproduce the audio signals at original quality levels. A recording system designed to achieve the high 
fidelity is sought. In other words, development of optical discs capable of recording audio signals witiiin a band of twice 
that of a conventional CD is expected. 

Such high-quality hi-fi signals do not deteriorate in a duplication process as long as they are copied in digital form, 
which is quite convenient for users, but undesirable from tiie viewpoint of copyright protection. For avoiding such a prob- 
25 lem, a system designed to limit the number of copies of digital information (U.S.R No. 5,428,598). a system having no 
digital signal output terminals, a system designed to remove part of a band of an analog output signal, a system embed- 
ding copyright data into digital data (U.S. R No. 5,319,735), and a system identifying an user who made a copy by 
detecting an identification signal formed by slightly changing original data, have been proposed. 

The system embedding copyright data into digital data, however, has the drawback in that D/A conversion of tiie 
30 digital data Into analog audio signals in a reproduction operation would cause reproduced sound quality to be deterio- 
rated or changed uncomfortably. 

SUMMARY OF THE INVENTION 

35 It Is therefore a principal object of the present Inventbn to avoid the disadvantages of tiie prior art. 

It is another object of tiie present invention to provide a copyright Information embedding system designed to 
embed information for copyright protection into digital signals without deterioration of analog signals reproduced. 

According to one aspect of the present invention, there is provided a copyright information embedding apparatus 
which corrprises: (a) an A/D conversion means for converting an analog audio signal into a digital signal; (b) a modu- 
40 lation means for modulating a copyright data signal for the digital signal using spectrum spread; (c) a level detection 
means for detecting a variation in level of tiie digital signal; and (d) a copyright data embedding circuit embedding the 
copyright data signal into the digital signal when tiie variation in level of the digital signal detected by tiie level detection 
means shows a preselected variation. 

In the prefenred nxxle of tiie invention, tiie copyright data embedding circuit embeds the copyright data into the dig- 
45 ital signal during a time when a level of the digital signal is decreased. 

The copyright data embedding circuit may alternatively embed the copyright data into tiie digital signal during a 
time when a level of tiie digital signal is increased. 

The copyright data embedding circuit divides tiie copyright data into several codes and embeds tiiem into the digital 
signal intermittentiy. 

50 The copyright data embedding circuit may record the copyright data Into the digital signal in random cycles. 

The copyright data embedding circuit may also embed tiie copyright data into the digital signal when an average 
le/el of the digital signal sampled over a preselected period of time is greater than a given value. 

According to another aspect of the Invention, there is provided a record can-ier which comprises: (a) a digital signal 
into which an analog audio signal is converted; and (b) a copyright data signal can-ying copyright information about tiie 
55 digital signal, modulated with spectrum spread, the copyright data signal being embedded Into the digital signal each 
time a variation in level of the digital signal shows a preselected variation. 

In the preferred mode of the invention, the copyright data signal is embedded into the digital signal during a time 
when a level of tiie digital signal is decreased. 
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The copyright data signal may alternatively be embedded into the digital signal during a time when a level of the 
digital signal is inaeased. 

The copyright data signal may be embedded into the digital signal intermittently. 

The copyright data signal may be embedded into the digital signal In random cycles. 
5 The copyright data signal may also be embedded into the digital signal when an average level of the digital signal 
sampled over a preselected period of time is greater than a given value. 

A second copyright data signal identical with the copyright data signal is recorded on a subcode of the digital signal. 

A third copyright data signal identical with the copyright data signal Is recorded on a copyright information manage- 
ment area defined on the record cannier. 
10 According to the third aspect of the invention, there is provided a copyright information embedding apparatus which 
comprises: (a) an A/D conversion means for converting an analog audio signal into a digital signal; (b) a modulation 
means for modulating a copyright data signal carrying copyright information about the digital signal using spectrum 
spread; (c) a frequency detection means for detecting a frequency of the digital signal; and (d) a copyright data embed- 
ding circuit embedding the copyright data signal into the digital signal at a preselected power level different from that of 
75 the digital signal. 

In the preferred mode of the invention, the copyright data embedding circuit detects a variation in level of the digital 
signal and changes the power level according to the variation in level detected. 

The copyright data embedding circuit may embed the copyright data signal into the digital signal at the preselected 
power level regardless of the variation in level of the digital signal when an average level of the digital signal sampled 
20 over a preselected period of time is greater than a given value. 

According to the fourtii aspect of the invention, there is provided a record carrier which comprises: (a) a digital sig- 
nal into which an analog audio signal is converted; and (b) a copyright data signal carrying copyright information about 
the digital signal, modulated with spectrum spread, the copyright data signal being embedded into the digital signal at 
a preselected power level different from that of tiie digital signal. 
25 In the preferred mode of the invention, the preselected power level is changed according to a variation in level of 
the digital signal. 

The copyright data signal may be embedded into the digital signal at the preselected power level regardless of the 
variation in level of the digital signal when an average level of the digital signal sampled ever a preselected period of 
time is greater tiian a given value. 
30 A second copyright data signal identical witti the copyright data signal nr^y be recorded on a subcode of the digital 
signal. 

A third copyright data signal identical with the copyright data signal may be recorded on a copyright information 
management area defined on tiie record carrier. 

According to the fifth aspect of the present invention, tiiere is provided a copyright information embedding method 
35 comprising the steps of: (a) A/D-converting an analog audio signal into a digital signal; (b) modulating a copyright data 
signal for the digital signal using spectrum spread; (c) detecting a variation in level of the digital signal; and (d) embed- 
ding the copyright data signal into the digital signal when tiie variation in level of the digital signal detected by the level 
detection means shows a preselected variation. 

According to tiie sixth aspect of the present invention, there is provided a copyright information embedding method 
40 comprising the steps of: (a) A/D-converting an analog audio signal into a digital signal; (b) modulating a copyright data 
signal carrying copyright information about tiie digital signal using specti'um spread; (c) detecting a frequency of the 
digital signal; and (d) embedding the copyright data signal into tiie digital signal at a preselected power level different 
from tiiat of the digital signal. 

According to the seventh aspect of the present invention, there is provided a copyright information embedding 
45 apparatus which comprises: (a) an A/D conversion means for converting an analog audio signal Into a digital signal; (b) 
a modulation means for modulating a copyright data signal for the digital signal using spectrum spread; (c) a level detec- 
tion means for detecting a level of the digital signal; and (d) a copyright data embedding circuit embedding the copyright 
data signal into the digital signal when the level of the digital signal detected by ttie level detection means lies within a 
preselected range. 

so 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will be understood more fully from the detailed description given hereinbelow and from the 
accompanying drawings of tiie preferred embodiment of the invention, which, however, should not be taken to limit the 
55 invention to ttie specific embodiment but are for explanation and understanding only. 
In the drawings: 

Fig. 1 is a block diagram which shows a copyright information embedding apparatus according to tiie present inven- 
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tion; 

Fig. 2 is a block diagram which shows a circuit structure of a signal processing circuit of the copyright information 
embedding apparatus in Fig. 1 ; 

Fig. 3 is a graph which shows a data stream sampled by an A/D converter; 
5 Rg. 4 shows a user data code provided by an allocation circuit of the signal processing circuit In Fig. 2; 

Fig. 5 is a flowchart of a program of a copyright data embedding operation performed by a control circuit of the sig- 
nal processing circuit shown in Fig. 2 according to the first embodiment of the invention; 
Fig. 6(a) shows a waveform of an original Input signal; 

Fig. 6(b) shows the relation among a peak level, an average level of a signal into which the original input signal in 
10 Fig. 6(a) is converted In digital fbmi. and the time during which a copyright data signal is embedded; 

Fig. 7 is a flowchart of a program of a copyright data embedding operation which is a modification of the one shown 

in Fig. 5; 

Fig. 8 is a block diagram which shows a decoder of the invention; 
Rg. 9 is a circuit diagram which shows a signal processing circuit of the decoder in Fig. 8; 
75 Rg. 10 is a graph which shows a data stream interpolated by an interpolator in Fig. 9; 

Fig. 1 1 is a block diagram which shows a signal processing circuit which is a modification of the one shown in Fig. 2; 
Fig. 12 is a circuit diagram which shows a signal processing circuit which is a modification of the one in Fig. 9; 
Fig. 13 is a flowchart of a program of a copyright data embedding operation according to the second embodiment 
of the invention; 

20 Fig. 14(a) shows a waveform of an original input signal; 

Fig. 14(b) shows the relation among a peak level, an average level of a signal into which the original input signal in 
Fig. 14(a) is converted in digital form, and the time during which a copyright data signal is embedded; 
Fig. 15 is a flowchart of a program of a copyright data embedding operation according to the third embodiment of 
the invention; 

25 Rg. 1 6 is a flowchart of a program of a copyright data embedding operation according to the fourth embodiment of 

the invention; 

Fig. 17(a) shows a waveform of an original input signal; 

Fig. 1 7(b) shows the relation among a peak level, an average level of a signal into which the original input signal in 
Rg. 17(a) is converted in digital form, and the time during which a copyright data signal is embedded; 
30 Rg. 18 IS a flowchart of a program of a copyright data embedding operation according to the fifth embodiment of 

the invention; 

Fig. 19 is a flowchart of a program of a copyright data embedding operation according to the sixth embodiment of 
the invention; 

Fig. 20(a) shows a waveform of an original input signal; 
35 Rg. 20(b) shows the relation among a peak level, an average level of a signal into which the original input signal in 
Fig. 20(b) is converted in digital form, and the time during which a copyright data signal is embedded; 
Fig. 21 is a flowchart of a program of a copyright data embedding operation which is a modification of the sixth 
embodiment; 

Fig. 22 Is a flowchart of a program of a copyright data embedding operation according to the seventh embodiment 
40 of the invention; 

Fig. 23 is a flowchart of a program of a copyright data embedding operation which is a modification of the seventh 
embodiment in Fig. 22; 

Fig. 24(a) shows a waveform of an original input signal; 

Rg. 24(b) shows the relation among a peak level, an average level of a signal into which tiie original input signal in 
45 Rg. 24(a) is converted In digital form, and tiie time during which a copyright data signal is embedded; 

Fig. 25 is a block diagram which shows a signal processing circuit according to the eighth embodiment of the inven- 
tion; 

Fig. 26 is a graph which shows an audibility masking effect; 

Rg. 27 is a graph which shows tiie relation between a masking sensitivity and the frequency; 
50 Rg. 28 is a graph which shows a OMR (Code to Music Ratio) between an original signal and a copyright data signal 
in terms of the frequency; 

Fig. 29 is a flowchart of a program of a copyright data embedding operation according to the ninth embodiment; 
Fig. 30(a) shows a waveform of an original input signal; 

Rg. 30(b) shows tiie relation between a peak level and an average level of a signal into which the original input sig- 
55 nal in Rg. 30(a) is converted In digital form; 

Fig. 30(c) shows a variation in level of a copyright data signal; 

Fig. 31 is a flowchart of a program of a copyright data embedding operation which is a nKXjification of the ninth 
embodiment shown in Fig. 29; 
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Fig. 32 is a circuit diagram which shows a modification of a signal processing circuit of the eighth embodiment 
shown in Frg. 25; 

Fig. 33 illustrates a packet structure of a DVD (Digital Video Disc); 

Fig. 34 shows another CMR between an original signal and a copyright data same as Fig. 28; 
5 Fig. 35(a) shows a waveform of an original input signal; and 

Fig. 35(b) shews the relation between a peak level and an average level of a signal In Fig. 31 . 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

10 Referring now to the drawings, particularly to Rg. 1 . there is shown a copyright infbrnmtion embedding apparatus 
(encoder) 300 according to the present invention. 

The copyright information embedding apparatus 300 includes generally an A/D converter 31 , a signal processing 
circuit 32. a memory 33, a DVD encoding circuit 34, and a modulation circuit 35. When an analog signal such as an 
audio signal is inputted to an input terminal IN, it is sampled by the A/D converter 31 at a high sampling frequency (i.e.. 

15 sampling periods At in Fig. 3). for example. 192kHz enough to prohibit digital copying without authorization and con- 
verted into, for example, a data stream of 24-bit high-resolution PCM signals, as shown below, along a curve a in Rg. 3. 

xb1,x1,xa1,x2, xb2, x3, xa2, • • • xt>i, x2i-1,xai, x2i • • • 

20 The above data stream is encoded by the signal processing circuit 32 and the memory 33 and packed by the DVD 
encoding circuit 34, which is, in turn, outputted directly from an output terminal 0UT1 or modulated by the modulation 
circuit 35 according to a type of record carrier and outputted from an output terminal 02. From an output terminal 03. 
copyright data Is outputted as needed. 

Fig. 2 shows a circuit structure of the signal processing circuit 32. 

25 An output signal from the A/D converter 31 is inputted to an adder circuit 121. The adder drcuit 121 adds copyright 
data, as will be discussed later in detail, to the input signal and outputs it to a low-pass filter (LPF) 36. The LPF 36 
includes, for example, a FIR fitter allowing signals having frequencies within a 1/2 band to pass therethrough and 
selects a data stream of xcl , xc2, xc3, xcl, • • along a curve ft as shown in Fig. 3, from 

the data stream of xbi. x2i-1 , xai, x2i along the curve a. 

30 A decimating circuit 37 removes data samples * from the data stream outputted from the LPF 36 to produce a data 
stream of xcl , xc2, xc3, • • • , xci, • • • . Similarly a dedmating circuit 38 removes data samples xi from the data 
stream outputted from the LPF 36 to produce a data stream of xbi . xai . xb2. xa2. * • * . xbi, xai. • • * . 

A difference calculating circuit 39 which includes an adder determines differences Mi (=xib- xcl) and 
A2i (= xai - xci) based on the data streams outputted from the decimating circuits 37 and 38. The difference data Alt 

35 and A2i each consist of 24 or less bits. The number of bits may be either fixed or changed. 

An allocation circuit 40 packs the data stream xci from the decimating drcuit 37, the difference data Ali and A2i, 
and copyright data together to produce user data codes (one is shown in Fig. 4) which are, in turn, recorded on a DVD 
(digital video disc) or outputted to a transmission path, for example. When recorded in the DVD, each user data code 
consists of 2034 bytes as shown in Fig. 33. the number of pieces of each of the data xci. the difference data A1 i and A2i 

40 are 225. and each data consists of 3 bytes, and a subheader consists of a 9 bytes. The data stream of xd corresponds 
to a data stream sampled at a sampling frequency of one-fourth that in the A/D converter. 
Embedding of copyright data will be discussed below. 

A copyright data generator 100 produces copyright data on an audio signal inputted to the input terminal IN which 
comprises, for example, a copyright serial number ISRC (International Standard Recording Code. 16 bytes or less) for 
45 copyright management, a cutting player identification code (4 types or less) which is used as a SID (Source Identifica- 
tion) code, a recording date (3 bytes), a number of a recording (3 bytes), the number of copies (4 bytes), and the 
number of times allowing a copy to be made (3 bytes) and supplies it both to an FM modulator 114 and the allocation 
circuit 40. 

The allocation circuit 40 divides the copyright data into several pieces and adds them to some of the subheaders 
so of the user data codes, as shown in Fig. 4. In case of a DVD. the copyright data Is also recorded in a copyright manage- 
ment information (CM I) area formed on an Inner peripheral section of the DVD which corresponds to a TOC area pro- 
vided on a CDR disc, for example. The CMI area is defined within a partial RAM or a RCA (post cutting area), BCA 
(burst cutting area). 

The FM modulator 1 1 4 modulates the copyright data at a frequency of. for example, 5kHz outputted from an oscil- 
55 lator 1 15 and supplies it to a spread modulator 1 16. The spread modulator 1 16 spreads the frequency spectrum of the 
copyright data modulated by the FM modulator 1 14 using a spread code generated by a spread code g^ierator 1 17 so 
that it cannot be perceived acoustically even if D/A converted. A level control drcuit 1 18 controls the level of an output 
from the spread modulator 1 1 6 according to the level of the data stream (xbi, xai ) outputted from the dedmating circuit 
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38. For example, when the frequency of an original audio signal is 2kHz. the level control circuit 1 18 decreases the level 
of the output from the spread modulator 116 by •25dB. When it is 10kHz, the level of the output from the spread mod- 
ulator 116 is decreased by -19dB. Specifically, the level control circuit 118 decreases the level of the output from the 
spread modulator 1 1 6 below a CMR (Code to Music Ratio) in a psychoacoustic model so that the copyright data cannot 
5 be perceived acoustically by a listener and provides a level-controlled signal to the adder 121 through a switch 201 to 
embed it into the output signal from the A/D converter 31 . 

The control circuit 200 provides control signals a. b, and c to the copyright data generator 100, the spread code 
generator 117. and the switch 201 in a copyright data embedding operation. 

Fig. 5 shows a program or sequence of logical steps of the copyright data embedding operation performed by the 
10 control circuit 200. 

After entering the program, the routine proceeds to step 10 wherein an output signal from the A/D converter 31 is 
filtered using a weighting filter to decrease the level thereof in a high and middle (high-mid) frequency band for modify- 
ing the audibility. The routine proceeds to step 20 wherein an average level Lav (a corrected value) and a peak level Lp 
of the filtered signal outputted from the A/D converter 31 are determined. For example, the average level Lav is deter- 
15 mined by sampling the signal outputted from the A/D converter 31 over 300 msec, so that it may, as shown in Rg. 6(b), 
coincide with the peak level Lp when a given number of consecutive constant amplitudes of an original signal, as shown 
in Fig. 6(a), appear. 

The routine proceeds to step 30 wherein it is determined whether the peak level Lp is greater than the average level 
Lav or not. If a YES answer is obtained (Lp > Lav), then the routine proceeds to step 40 wherein the control circuit 200 
20 provides the control signals a. t2. and c of an ON-level to the copyright data generator 100, the spread code generator 
1 1 7. and the switch 201 to start the copyright data embedding operation. Specifically, the copyright data generator 1 00 
produces the copyright data to the allocation circuit 40 and the FM modulator 114. The spread modulator 116 modu- 
lates the output from the FM modulator 1 14 in response to the control signal h inputted to the spread code generator 
117. The switch 201 is turned on to embed the copyright data level-controlled by the level control circuit 1 18 into the 
25 output from the A/D converter 31 through the adder 121. 

Alternatively, if a NO answer is obtained in step 30, then the routine proceeds to step 50 wherein the control circuit 

200 provides the control signals a, b, and c of an OFF-level to the copyright data generator 100, the spread code gen- 
erator 117, and the switch 201 to prohibit the copyright data embedding operation. Specifically, the copyright data gen- 
erator 100 hokis the copyright data from being outputted to the allocation circuit 40 and the FM modulator 114. The 

30 spread modulator 116 is deactivated. The switch 201 is turned off to block the communication between the adder 121 
and the level control circuit 1 18. If the control signals ^ b, and g. of the OFF-level are provided before one of data codes 
constituting the copyright data is recorded completely, the copyright data embedding operation is deactivated after com- 
pletion of recording of that data code. 

Fig. 7 shows a program of the copyright data en^edding operation performed by the control circuit 200 which is a 

35 modification of the one shown in Rg. 5. The same reference numbers as employed in Rg. 5 refer to the same steps, 
and explanation thereof in detail will be omitted here. 

After step 20, the routine proceeds to step 130 wherein it is determined whether the average level Lav is greater 
than a value of a full peak minus 1 9dB or not. The full peak is an upper limit at which a signal is allowed to be recorded. 
If a YES answer is obtained, then the routine proceeds to step 40 wherein the control circuit 200 provides the control 

40 signals a. b. and q of the ON-level to the copyright data generator 100. the spread code generator 1 1 7. and the switch 

201 to start the copyright data embedding operation. Alternatively, if a NO answer is obtained in step 130, then the rou- 
tine proceeds to step 30 wherein it is determined whether the peak level Lp is greater than the average level Lav or not. 
If a NO answer is obtained, then the routine proceeds to step 50 wherein the control circuit 200 provides the control 
signals a, b. and £ of an OFF-level to the copyright data generator 100. the spread code generator 1 17. and the switch 

45 201 to prohibit the copyright data embedding operation. 

Fig. 8 shows a circuit structure of a decoder 500 according to the present invention. 

The decoder 500 includes a demodulator 41 . a DVD decoding circuit 42, a signal processing circuit 43, a memory 
44, a decoder/comparator 50, a copyright data updating circuit 30, a low-pass filter 53, and a D/A converter 56. 

When a signal coded by the copyright information embedding apparatus 300 is inputted to the denrKxlulator 41 , the 
so demodulator 41 demodulates the input signal according to a modulation format of the modulating circuit 35 of the cop- 
yright information embedding apparatus 300 and outputs it to the DVD decoding circuit 42. The DVD decoding circuit 
42 decodes the input signal and provides decoded signals each consisting of the data stream of xci into which the cop- 
yright data is embedded and the difference data Ali and A2i to the signal processing circuit 43 and the copyright data 
updating circuit 30. The DVD decoding circuit 42 also provides the copyright data which is unpacked from the subhead- 
55 ers of the user data codes or reproduced from the CMI area of the DVD to the decoder/comparator 50. 

The signal processing circuit 43 includes, as shown in Fig. 9. an adder 46 and an interpolator 47. The adder 46 
receives the decoded signal outputted from the DVD decoding circuit 42 and performs addition operations, as shown 
below, to restore the data stream of xbi and xai each consisting of 24 bits similar to the original data stream. 
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Ali-i-xci =xbi 
A2i + xci s xai 

The interpolator 47 finds or interpolates data xi. as shown in Rg. 10. intermecfiate between the data xai and M. 
The interpolation of the data xi may be achieved by setting the data xi to zero (0) using the so-called up sampling tech- 
nique and passing them through a low-pass filter. The data xi may alternatively be found with curve approximation or 
predictive approximation. In case of the predicative approximation, a measure of approximation may be Improved by 
adding approximated subdata to the difference data All and A2I. 
The data xai. xbi. and xi are anranged as follows: 

xbi, xi, xai. x2, xb2, x3, xa2, • • • xbi, x2i-1. xai, x2l, • • • 

The above data stream Is supplied from the signal processing circuit 43 to the D/A converter 55. the LPF 56. and 
a digital output terminal 90. 

The D/A converter 45 converts the data stream of xbi. x2i-1 , xai, and x2i. which are A/D converted by the encoder 
(i.e., the copyright information embedding apparatus 300) with 24 quantization bits and into which the copyright data is 
embedded, into an analog signal at a sampling frequency of 192kHz and outputs it through an analog output terminal 
55. The LPF 56 passes the input signal from the signal processing circuit 43 within a frequency band (e.g.. 48kHz) of 
one-fourth that of the Input signal and outputs It through an output terminal 53. The data stream of xbi, x2i-1. xai. and 
x2i outputted from the signal processing circuit 43 is also outputted directly from a digital output terminal 90. 

Figs. 11 and 12 show modifications of the encoder (i.e., the copyright information embedding apparatus 300) 
shown in Rgs. 1 and 2 and the decoder shown in Figs. 8 and 9, respectively The same reference numbers as employed 
in the above embodiments refer to the same parts, and explanation thereof in detail wilt be omitted here. 

The encoder 310. as can be seen from the drawing, does not have the decimating circuit 38 which removes the 
data xi from the input signal. Specifically, the difference calculating circuit 39 determines difference data Alt. A2i. and 
A3i, as shown below. 

xt)i-xcls Ali 

30 

xai - xci = A2i 
xi - xd s A3i 

35 The allocation circuit 40 packs the data stream of xd, A1 i . A2i. and A3i and the copyright data together and outputs 
it. The copyright data is, similar to the first embodiment, embedded Into the data stream of xd, All, A2i, and A3I inter- 
mittently. 

The decoder, as clearly shown in Fig. 1 2, does not have the interpolator 47 in Fig. 9 because the encoder 310 does 
not remove or decimate the data xi. Specifically, the adder 46 performs addition operations below to restore the original 
40 data stream of xbi, x2l-1 . xai, and x2i. The other arrangements are kientical with those shown in Rg. 8, and explanation 
thereof will be omitted here. 

xci + Ali = xbi 

45 xci + A2i = xai 

xci + A3i = xl 

Fig. 13 show a program of the copyright data embedding operation according to the second embodiment of the 
so invention. 

After entering the program, the routine proceeds to step 210 wherein the control circuit 200 sets a rising time con- 
stant and a falling time constant to. for example, 1 msec, and 150 msec, respectively, to determine a peal level Lp of 
an output from the A/D converter 31 . The routine proceeds to step 220 wherein an average level Lav is determined in 
the same manner as discussed above In Fig. 5. The routine proceeds to step 230 wherein it is determined whether the 
55 peak level Lp Is smaller than the average le/el Lav or not. If a NO answer is obtained, then the routine proceeds directly 
to step 50 to prohibit the copyright data embedding operation. Alternatively, if a YES answer is obtained in step 230, 
then the routine proceeds to step 240 wherein it is determined whether or not the YES answer in step 230 has been 
obtained In the first program cyde following a program cyde wherein the NO answer was obtained in step 230. If a YES 
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answer is obtained, then the routine proceeds to step 40 wherein the control circuit 200 provides the control signals a. 

and £ of the ON-le^el to the copyright data generator 1 00. the spread code generator 1 1 7, and the switch 201 to start 
the copyright data embedding operation. 

Specifically, the copyright data Is embedded Into the output from the A/D converter 31 for a period of time during 
5 which one program cyde Is completed Immediately after the peak level Lp drops, as shown In Fig. 1 4(b). It is known In 
the art that a signal which Is embedded Into an audio signal changing in level, as shown In Fig. 14(a). when the audio 
signal drops in level rapidly, is difficult to perceive acoustically 

Fig. 15 shows a program of the copyright data embedding operation according to the third embodiment which is a 
combination of the ones shown in Figs. 7 and 13. The same step numbers as employed in Figs. 7 and 13 refer to the 
10 same steps. 

In steps 210 and 220, the average level Lav and the peak le^el Lp of an output signal from the A/D converter 31 are 

determined. 

The routine proceeds to step 1 30 wherein It Is determined whether the average level Lav Is greater than a value of 
a full peak minus 19dB or not. If a YES answer Is obtained, then the routine proceeds to step 40 wherein the control 

15 circuit 200 provides the control signals a, ^ and c of the ON-level to the copyright data generator 1 00. the spread code 
generator 117. and the switch 201 to start the copyright data embedding operation. Alternatively, if a NO answer is 
obtained in step 1 30, then the routine proceeds to step 230 wherein it is determined whether the peak level Lp is smaller 
than the average level Lav or not if a NO answer is obtained, then the routine proceeds to step 50 wherein the control 
circuit 200 provides the control signals a, ^ and q of an OFF-level to the copyright data generator 100, the spread code 

20 generator 1 1 7. and the switch 201 to prohibit the copyright data emt>edding operation. Alternatively, if a YES answer is 
obtained, then the routine proceeds to step 240 wherein it is determined whether the YES answer in step 230 has been 
obtained in the first program cycle following a program cycle wherein the NO answer was obtained in step 230 or not. 
If a YES answer Is obtained, then the routine proceeds to step 40. Alternatively if a NO answer is obtained, then the 
routine proceeds to step 50 wherein the control circuit 200 provides the control signals a, b. and £ of an OFF-level to 

25 the copyright data generator 100, the spread code generator 117, and the switch 201 to prohibit the copyright data 
embedding operation. 

Fig. 16 shows a program of the copyright data embedding operation according to the fourth embodiment which is 
a modification of the one shown In Fig. 13. The same step numbers as enployed in the second embodiment in Rg. 13 
refer to the same steps. 

30 After step 220, the routine proceeds to step 430 wherein it is determined whether the peak level Lp is greater than 
the average level Lav or not. If a NO answer is obtained, then the routine proceeds to step 50 wherein the control circuit 
200 provides the control signals a. b, and c of the OFF-level to the copyright data generator 1 00, the spread code gen- 
erator 117, and the switch 201 to prohibit the next copyright data embedding operation. Alternatively, if a YES answer 
is obtained, then the routine proceeds to step 240 wherein it is determined whether the YES answer in step 430 has 

35 been obtained in the first program cycle following a program cyde wherein the NO answer was obtained in step 430 or 
not. If a YES answer is obtained, then the routine proceeds to step 40 wherein the control drcuit 200 provides the con- 
trol signals a. b, and c of the ON-level to the copyright data generator 100, the spread code generator 117, and the 
switch 201 to start the copyright data embedding operation. Alternatively, if a NO answer is obtained in step 240, then 
the routine proceeds to step 50. 

40 Specifically, the copyright data is, as can be seen from Rgs. 1 7(a) and 1 7(b), embedded into an output signal from 
the A/D converter 31 for each period of time during which the level of the output from the A/D converter 31 rises. It is 
understood that the copyright data will not be perceived acoustically when it is embedded into a sound signal at a time 
when the level of the signal is, as shown in Fig. 1 7(b), changed greatly. 

Fig. 18 shows a program of the copyright data embedding operation according to the fifth embodiment which Is a 

45 combination of the ones shown in Rgs. 7 and 15. The same step numbers as employed in Figs. 7 and 15 refer to the 
same steps. 

After step 220. the routine proceeds to step 130 wherein It Is determined whether the average level Lav is greater 
than a value of a full level minus 19dB or not. If a YES answer is obtained, then the routine proceeds to step 40 wherein 
the control drcuit 200 provides the control signals a, ^ and £ of the ON-level to the copyright data generator 100, the 

50 spread code generator 1 17, and the switch 201 to start the copyright data embedding operation. Alternatively, if a NO 
answer is obtained in step 130. then the routine proceeds to step 30 wherein it is determined whether the peak level Lp 
Is greater than the average level Lav or not. If a NO answer is obtained, then the routine proceeds to step 50 wherein 
the control circuit 200 provides the control signals & b, and q of an OFF-level to the copyright data generator 100, the 
spread code generator 117, and the switch 201 to prohibit the copyright data embedding operation. 

55 Alternatively, if a YES answer is obtained in step 30, then the routine proceeds to step 240 wherein it is determined 
whether the YES answer in step 30 has been obtained in the first program cycle following a program cyde wherein the 
NO answer was obtained in step 30 or not. If a YES answer is obtained, then tiie routine proceeds to step 40. If a NO 
answer is obtained, then the routine proceeds to step 50. 
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Fig. 19 shows a program of the copyright data embedding operation according to the sixth embodiment. The same 
step numbers as employed in the above embodiments refer to the same steps. 

if a NO answer Is obtained in step 240. then the routine proceeds to step 800 wherein an embedding flag F is set 
to one (1). The routine proceeds to step 50 wherein the copyright data embedding operation is paused and then returns 
5 back to step 210. 

Alternatively, if a YES answer is obtained in step 240, then the routine proceeds to step 500 wherein it Is deter- 
mined whether the embedding flag F is one (1) or not. If a YES answer is obtained, then the routine proceeds to step 
470 wherein a timer is actuated to determine whether one (1) millisec. has passed or not. If a NO answer is obtained, 
then the routine proceeds to step 40 to perform the copyright data embedding operation. 

10 Alternatively, if a YES answer is obtained in step 470. then the routine proceeds to step 490 wherein it Is deter- 
mined whether one point five (1 .5) sec. has passed or not. If a YES answer Is obtained, then the routine proceeds to 
step 700 wherein the embedding flag F is set to one (1). Alternatively if a NO answer is obtained, then the routine pro- 
ceeds to step 600 wherein the embedding flag F is set to zero (0) and proceeds to step 50 to hold the copyright data 
embedding operation from being started. 

75 If a NO answer is obtained (F » 0) in step 500. then the routine proceeds directly to step 490. 

Specifically the copyright data is. as shown in Figs. 20(a) and 20(b). embedded into an output signal from the A/D 
converter 31 for one (1) millisec. following a rise of the signal. The copyright data embedding operation Is performed a 
given number of times at intervals longer than at least 1 .5 sec. until the contents of the copyright data are all recorded. 
In other words, the copyright data is embedded into the output from the A/D converter 31 in a burst form. This avoids 

20 degradation in quality of analog signals that are reproduced. 

Fig. 21 shows a program of the copyright data embedding operation which is a modification of the sixth embodi- 
ment in Fig. 19. The same step numbers as employed in Fig. 19 refer to the same steps. 

After step 220, the routine proceeds to step 130 wherein it is determined whether the average level Lav Is greater 
than a value of a full level minus 19dB or not. If a YES answer is obtained, then the routine proceeds to step 500. Alter- 

25 natively if a NO answer is obtained, then the routine proceeds to step 430. This emttodiments. likewise to the sixth 
embodiment, embeds the copyright data into an output signal from the A/D converter 31 for one (1) millisea following 
a rise of the signal a given number of times at intervals longer than at least 1 .5 sec. 

Fig. 22 shows a program of the copyright data embedding operation according to the seventh embodiment which 
is a modification of the sixth embodiment in Fig. 19. The same step numbers as employed in Fig. 19 refer to the same 

30 Steps. 

This program is designed to change time intervals or cycles Tx, at random, in which the copyright data embedding 
operations are performed for preventing the copyright data from being recorded at constant time intervals. 

If a YES answer is obtained in step 470 meaning that one (1) millisec. has passed, that is, that the copyright data 
embedding operation is completed, then the routine proceeds to step 491 wherein the cycle Tx Is determined at random 
35 within a range from 10 millisec. to 1 .5 sec. The routine proceeds to step 492 wherein it is deternrtined whether the cyde 
Tx has passed or not. If a YES answer is obtained, then the routine proceeds to step 700 wherein the embedding flag 
F is set to one (1), Alternatively if a NO answer is obtained, then the routine proceeds to step 600 wherein the embed- 
ding flag F is set to zero (0). 

Fig. 23 shows a program of the copyright data embedding operation which Is a modification of the seventh embod- 
40 iment in Fig. 22. The same step numbers as employed In Fig. 22 refer to the same steps. 

After step 220, the routine proceeds to step 130 wherein It Is determined whether the average level Lav is greater 
than a value of a full level minus 19dB or not. If a YES answer Is obtained, then the routine proceeds to step 500. Alter- 
natively if a NO answer is obtained, then the routine proceeds to step 430. 

Specifically the copyright data is, as shown In Fig. 24(b), embedded into an output signal from the A/D converter 
45 31 each time the level of the signal rises. Additionally the copyright data is also embedded in different cycles Tx as long 
as the average level Lav is greater than the value of the full level minus 19dB. 

The decoder 500, as shown in Fig. 8, Is designed to output a bit stream read out of a record earner (e.g., a DVD) 
as is through the copyright data updating circuit 30, the switch 51 , and the bit stream output terminal 52. An identifica- 
tion code is inputted to tiie decoder/comparator 50 from tiie terminal 49. The decoder/comparator 50 is responsive to 
50 the identification code and tiie copyright data inputted from ttie DVD decoding circuit 42 to dose the switch 51 and to 
control the copyright data updating circuit 30. 

Specifically when the identification code is inputted, the decoder/comparator 50 determines whetiier it is correct or 
not. If tiie identification code inputted is determined to be correct, the decoder/comparator 50 checks copy information 
contained in the copyright data, for example, the number of copy allowable times allowing a copy to be made, tf it shows 
55 a value other tiian zero (0), the decoder/comparator 50 controls ttie copyright data updating drcult 30 to decrement a 
value contained in the input bit stream lndk;ative of tiie number of copy allowable times by one (1) and doses tiie switch 
51 , allowing tiie bit sti^eam to be outputted from tiie bit stream terminal 52. Alternatively if the number of copy allowable 
times shows zero (0), the decoder/comparator 50 opens the switch 51 to block tiie communication between the copy- 
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right data updating circuit 30 and the bit stream oulput terminal 52. thereby prohibiting a copy. 

A copy allowable term code may also be recorded on a record carrier in addition to the number of copy allowable 
times. In this case, the decoder/comparator 50 prohibits a copy when the copy allowable term expires even if the iden- 
tification code inputted is con-ect. 
5 Rg. 25 shows a circuit structure of the signal processing circuit 32 of the copyright infornrtation embedding appara- 
tus 300 according to the eighth embodiment of the invention. The same reference numbers as those in Rg. 2 refer to 
the same parts, and explanation thereof in detail will be omitted here. 

The signal processing circuit 32 of this embodiment, as can be seen from the drawing, does not have the switch 
201, and the control circuit 200 directly controls the level control circuit 1 18. The level control drcuit 1 18 controls the 
10 level of an oulput from the spread nruxJulator 1 16 based on the frequency of the data stream of xbi and xa1 outputted 
from the decimating circuit 38 and a control signal from the control circuit 200 and provides it to the adder 121. The 
adder 121 embeds the level-controlled signal from the level control circuit 118 into an output signal from the A/D con- 
verter 31 in a manner, as will be described below in detail. 

Rg. 26 demonstrates the so-called audibility masking effect. A solid tine represents a making curve defined by a 
75 nnaximum level of a signal (code) C to be masked by a signal (music) M. A masking sensitivity X (- OMR) depends upon 
the characteristics of the making signal M and is known as follows: 

about 25dB when the signal M likes a tone (close to sine wave) 
about 3dB when the signal M likes noise 

20 

An actual audio signal will further be close to a tone at lower frequendes, while at higher frequencies, overlap of 
harmonics of different musical instruments will cause noise. Therefore, the masking sensitivity X OMR) may be deter- 
mined, as shown in Rg. 26 and 27. according to the frequency of the signal M. 

Based on the above fact, the level control circuit 1 18 decreases the level of a modulated signal (i.e.. the signal C) 

25 of the copyright data down to at least a level, as shown by a solid tine CO in Rg. 28. which is an inaudible level lower 
than that of an original audio signal (i.e., the signal M) by the CMR (Code to Music Ratio) in the psychoacoustic model, 
as shown in Rg. 27. based on the frequency of the data stream of xbi and xal outputted from the dedmating drcuit 38. 
The adder 121 then, as described above, enrd3ecls the level-controlled signal from the level control circuit 1 18 into an 
output signal from the A/D converter 31 . 

30 Rg. 29 shows a program of the copyright data embedding operation performed by the control circuit 200 of the cop- 
yright information embedding apparatus according to the ninth embodiment. The same step numbers as employed In 
the above embodiments refer to the same steps, and explanation thereof in detail will be omitted here. 

In step 230, it is determined whether the peak level \4> is smaller than the average level Lav or not. If a NO answer 
is obtained, then the routine proceeds to step 560 wherein the level control drcuit 1 18 detects the frequency of the orig- 

35 inal audk> signal M (i.e., the frequency of the data stream of xbi and xal outputted from the decimating drcuit 38) and 
brings the level of a modulated signal outputted from the spread modulator 1 16 along the line CO. as shown in Rg. 28, 
according to the frequency detected. Alternatively, if a YES answer is obtained in step 230, then the routine proceeds 
to step 550 wherein the level control circuit 1 1 8 brings the level of the modulated signal from the spread nxxJulator 116 
along a broken line CI higher in level (i.e.. the energy density (dB/Hz)) than the line CO. 

40 Specifically, the modulated signal outputted from the spread modulator 116 is, as can be seen in Rgs. 30(a) to 
30(c). increased in level above the line CO for a period of time during which the average level Lav is deaeased to agree 
with the peak level Lp after the modulated signal drops in level. 

Rg. 31 shov^ a program of the copyright data embedding operation which is a modification of the one shown in 
Fig. 29. The same step numbers as employed in the above embodiments refer to the same steps. 

45 After step 220, the routine proceeds to step 130 wherein it is determined whether the average level is greater 
than a value of a full level minus 19dB or not. If a YES answer is obtained, then the routine proceeds to step 560 wherein 
the level control drcuit 118 brings the level of an output from the spread modulator 1 16 along the line CO. as shown in 
Fig. 28 or Fig. 34. according to the frequency of the original audio signal M. Alternatively, if a YES answer is obtained 
in step 230, then the routine proceeds to step 550 wherein the level control circuit 1 1 8 brings the level of the oulput from 

so the spread modulator 1 1 6 atong the broken line CI In Rg. 28 or Rg. 34. 

Fig. 32 shows a modification of the signal processing drcuit 32 of the copyright information embedding apparatus 
300 shown in Fig. 25. 

The signal processing circuit 32. as can be seen from the drawing, does not have the dedmating circuit 38 which 
renfK3ves the data xi from the input signal. Specifically, the difference calculating drcuit 39 determines difference data 
55 A1 i, A2i, and A3i, as shown below. 

xfc)i -xci = All 
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xai - xci = A2i 
xi - xci = A3i 

The allocation circuit 40 packs the data stream of xd. A1i, A2i, arxJ A3i and the copyright data together and outputs 
it. The copyright data is, similar to the eighth embodiment, embedded into the data stream of xci, A1 i, A2i. and A3i inter- 
mittently 

An decoder decoding a signal coded by the copyright information embedding apparatus including the signal 
processing circuit 32 in Fig. 32 has the same circuit structure as the one shown in Fig. 12. 

While the present invention has been disclosed in terms of the preferred embodiment in order to fedlitate a better 
understanding thereof, it should be appreciated that the invention can be embodied in various ways without departing 
from the principle of the invention. Therefore, the invention should be understood to include all possible embodiments 
and modification to the shown embodiments which can be embodied without departing from tiie prindple of the inven- 
tion as set forth in the appended claims. 

A copyright information embedding system Is provided which is designed to embed information for copyright pro- 
tection into digital audio signals without deterioration of analog audio signals reproduced. The copyright inforntation 
embedding system includes an A/D converter, a modulator, a level detector, and a copyright data embedding drcuit. 
The A/D converter converts an analog audio signal into a digital signal. The modulator modulates a copyright data sig- 
nal for the digital signal using spectrum spread. The level detector detects a variation in level of tiie digital signal. The 
copyright data embedding circuit divides the copyright data signal into several codes and embeds them into the digital 
signal each time the variation in level of the digital signal shows a preselected variation such as a rapid rise or drop. 

Claims 

25 1. A copyright information embedding apparatus comprising: 

A/D conversion means for converting an analog audio signal into a digital signal; 
modulation means for modulating a copyright data signal for said digKal signal using spectrum spread; 
level detection means for detecting a variation in level of said digital signal; and 
30 a copyright data embedding drcuit embedding tiie copyright data signal into the digital signal when tiie varia- 

tion in level of said digital signal detected by said level detection means shows a preselected variation. 

2. A copyright information embedding apparatus as set forth in daim 1 , wherein said copyright data embedding circuit 
embeds tiie copyright data into the digital signal during a time when a level of the digital signal is decreased. 

35 

3. A copyright information embedding apparatus as set forth in claim 1 , wherein said copyright data embedding circuit 
embeds tiie copyright data into tiie digital signal during a time when a level of the digital signal is increased. 

4. A copyright information embedding apparatus as set forth in daim 1 , wherein said copyright data embedding circuit 
40 records tiie copyright data into the digital signal intermittentiy 

5. A copyright information embedding apparatjs as set forth in daim 1 , wherein said copyright data embedding circuit 
records tiie copyright data into the digital signal in random cycles. 

45 6. A copyright information embedding apparatus as set forth in daim 1 , wherein said copyright data embedding circiDt 
also embeds the copyright data into the digital signal when a level of the digital signal sampled over a preselected 
period of time is greater than a given value. 

7. A record carrier comprising: 

50 

a digital signal into which an analog audio signal is converted; and 

a copyright data signal can-yrng copyright information about said digital signal, modulated with specti-um 
spread, said copyright data signal being embedded into said digtal signal each time a variation in level of said 
digital signal shows a preselected variation. 

55 

8. A record carrier as set forth in daim 7, wherein the copyright data signal is embedded into tiie digital signal during 
a time when a level of the digital signal is deaeased. 
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9. A record carrier as set forth in claim 7. wherein the copyright data signal is embedded into the digital signal during 
a time when a level of the digital signal is increased. 

10. A record carrier as set forth in claim 7. wherein the copyright data signal is embedded into the digital signal inter- 
5 mitlently 

1 1 . A record carrier as set forth in claim 7, wherein the copyright data signal is embedded into the digital signal in ran- 
dom cycles. 

10 12. A record carrier as set forth in claim 7, wherein the copyright data signal is also embedded into the digital signal 
when a level of the digital signal sampled over a preselected period of time is greater than a given value. 

13. A record carrier as set forth in claim 7, further comprising a second copyright data signal identical with said copy- 
right data signal which is recorded on a subcode of said digital signal. 

15 

14. A record carrier as set forth in claim 7, further comprising a second copyright data signal identical with said copy- 
right data signal which is recorded on a copyright information management area defined on the record carrier. 

15. A copyright information embedding apparatus comprising: 

20 

A/D conversion means for converting an analog audio signal into a digital signal; 

modulation means for modulating a copyright data signal carrying copyright information about said digital sig- 
nal using spectrum spread: 

frequency detection means for detecting a frequency of said digital signal: and 
25 a copyright data embedding circuit embedding the copyright data signal into the digital signal at a preselected 

power level different from that of said digital signal. 

16. A copyright information embedding apparatus as set forth in daim 15, wherein said copyright data embedding cir- 
cuit detects a variation in level of said digital signal and changes the power level according to the variation in level 

30 detected. 

17. A copyright information embedding apparatus as set forth in daim 16. wherein said copyright data embedding cir- 
cuit embeds the copyright data signal into the digital signal at the preselected power level regardless of the varia- 
tion in level of said digital signal when a level of the digital signal sampled over a preselected period of time is 

35 greater than a given value. 

18. A record carrier comprising: 

a digital signal into which an analog audio signal is converted; and 
40 a copyright data signal carrying copyright information about said digital signal, nfKxiulated with spectrum 

spread, said copyright data signal being embedded into said digital signal at a preselected power level different 
from that of said digital signal. 

19. A record carrier as set forth in claim 18. wherein the preselected power level is changed according to a variation in 
45 level of said digital signal. 

20. A record carrier as set forth in claim 19, wherein the copyright data signal is embedded into the digital signal at the 
preselected power level regardless of the variation in level of said digital signal when a level of the digital signal 
sampled over a preselected period of time is greater than a given value. 

50 

21 . A record carrier as set forth in daim 1 8. further comprising a second copyright data signal identical with said cop- 
yright data signal, recorded on a subcode of said digital signal. 

22. A record carrier as set forth in daim 18. further comprising a second copyright data signal identical with said cop- 
55 yright data signal, recorded on a copyright information management area defined on the record carrier 

23. A copyright information embedding method comprising the steps of: 
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A/D-converting an analog audio signal into a digital signal; 

modulating a copyright data signal for said digital signal using spectrum spread; 

detecting a variation in level of said digital signal; and 

embedding the copyright data signal into the digital signal when the variation In level of said digital signal 
detected by said level detection means shows a preselected variation. 

24. A copyright information embedding method comprising the steps of : 

A/D-converting an analog audio signal into a digital signal; 

HfKXIulating a copyright data signal carrying copyright information about said digital signal using spectrum 
spread; 

detecting a frequency of said digital signal; and 

embedding the copyright data signal into the digital signal at a preselected power level different from that of 
said digital signal. 

25. A copyright information embedding apparatus comprising: 

A/D conversion means for converting an analog audio signal into a digital signal; 

modulation means for modulating a copyright data signal for said digital signal using spectrum spread; 

level detection means for detecting a level of said digital signal; and 

a copyright data embedding circuit embedding the copyright data signal into the digital signal when the level of 
said digital signal detected by said level detection means lies within a preselected range. 
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